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The  Honorable  Jeff  Bingaman  Availability  Code3 

Ranking  Minority  Member  {Avail  and/or 

Subcommittee  on  Civil  Service,  bist  Special 

Post  Office  and  General  Services 
Committee  on  Governmental  Affairs  A 

United  States  Senate  /j.. I 

Dear  Senator  Bingaman: 

This  is  in  response  to  your  request  at  the  July  14,  1983, 
hearings  of  the  Subcommittee  on  Civil  Service,  Post  Office,  and 
General  Services,  Senate  Governmental  Affairs  Committee  on  the 
proposed  Merit  Pay  Reform  Act  of  1983.'  You  asked  for  our 
analysis  of  the  Office  of  Personnel  Management's  (OPM' s)  Report 
on  Pay  for  Performance  in  the  Federal  Government  -  1980-1982. * 
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merit  pay  population.  Our  2-year  analysis  included  question¬ 
naires  to  a  scientifically  selected  sample  of  merit  pay  em¬ 
ployees  in  these  agencies,  interviews  with  merit  pay  managers, 
reviews  of  agency  rating  and  payout  data,  and  analyses  of  em¬ 
ployees'  performance  elements  and  standards  for  both  1981  and 
1982.  Questionnaire  sample  sizes  were  sufficient  to  yield  an 
error  rate  of  less  than  5  percent  at  the  95-percent  confidence 
level.  We  also  reviewed  studies  of  merit  pay  by  OPM  and  inde¬ 
pendent  researchers,  and  testimony  from  representatives  of  em¬ 
ployee  and  management  groups  before  the  Congress. 

Based  on  the  information  available  to  us,  we  generally  dis¬ 
agree  with  OPM's  conclusions.  The  studies  and  analyses  OPM 
cites  as  the  basis  for  its  conclusions  are  either  not  current  or 
not  projectable  to  a  governmentwide  merit  pay  program.  For  ex¬ 
ample,  the  attitudinal  survey  used  for  OPM's  study  took  place  in 
1979  and  1980,  before  merit  pay  was  fully  implemented.  Also, 
the  actual  merit  pay  experiences  cited  by  OPM  were  either  from 
the  eight  agencies  that  implemented  merit  pay  a  year  early  for 
2,200  employees,  or  from  OPM's  own  merit  pay  experience  for  400 
merit  pay  employees.  According  to  OPM,  the  1982  merit  pay  popu¬ 
lation  was  about  108,000  employees. 

Our  reviews  of  the  merit  pay  system  identified  many  areas 
that  need  management  attention,  as  well  as  negative  employee 
perceptions  and  attitudes  toward  the  merit  pay  systems  in 
place.  While  pay-for-performance,  or  merit  pay,  may  have  been 
effective  in  providing  greater  rewards  for  employees  rated  above 
average  in  a  particular  merit  pay  pool,  these  rewards  are  not 
always  equitable  and  proportionate  when  one  compares  merit  pay 
increases  between  merit  pay  pools. 3  The  three  agencies  we  re¬ 
viewed  were  having  problems  with  employees'  acceptance  of  merit 
pay.  In  these  agencies,  7  percent  or  fewer  of  employees  in  each 
agency  in  both  years  wanted  to  retain  the  merit  pay  system  as 
implemented.  The  three  agencies  were  still  identifying  problems 
in  the  development  and  use  of  performance  standards,  rating 
distributions,  and  use  of  the  cash  awards  programs  as  an  inte¬ 
gral  part  of  merit  pay. 

While  our  reviews  have  identified  a  number  of  areas  in  the 
government's  merit  pay  system  needing  attention,  it  should  be 
recognized  that  considerable  time  is  generally  needed  before  a 
pay-for-performance  system  operates  smoothly.  Consequently,  it 
may  take  a  few  more  years  of  operation,  evaluations,  and  adjust¬ 
ments  before  the  positive  and  negative  aspects  of  the  merit  pay 


*Merit  pay  employees  are  divided  into  organizational  subunits 
or  pools  and  compete  with  other  pool  members  for  merit 
increases. 
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system,  and  the  feasibility  of  extending  it  to  all  federal 
employees  can  be  adequately  determined.  Our  specific  responses 
to  your  questions  are  contained  in  enclosure  I.  Enclosure  II  is 
a  copy  of  the  OPM  report. 

As  you  requested,  we  did  not  obtain  comments  on  this  report 
from  OPM.  Further,  as  arranged  with  your  office,  unless  you 
publicly  announce  its  contents  earlier,  we  plan  no  further  dis¬ 
tribution  until  7  days  from  the  date  of  this  report.  At  that 
time,  we  will  send  copies  to  interested  parties  and  to  others 
upon  request.  We  would  be  happy  to  discuss  these  issues  with 
you  if  you  wish. 

Sincerely  yours, 

William  J.  Anderson 

Director 

Enclosures  -  2 
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1 .  Do  you  agree  with- these  conclusions? 

We  do  not  have,  and  are  not  aware  of,  any  evidence  that 
would  support  OPM' s  broad  conclusion  that  "the  Federal  Govern¬ 
ment's  new  performance  appraisal  system  is  functioning  very 
well,  less  than  two  years  after  its  establishment."  To  the  con¬ 
trary,  we  have  two  ongoing  assignments  directed  at  the  perform¬ 
ance  appraisal  systems  of  several  executive  agencies  which  have 
identified  numerous  issues  with  the  performance  appraisal  sys¬ 
tems  that  need  management  attention.  For  example,  in  one  pool 
employees  rated  highly  satisfactory  received  increases  almost 
twice  as  large  as  employees  rated  outstanding  in  another  pool 
within  the  same  agency. 

Also,  we  are  not  aware  of  evidence  that  would  suggest  there 
is  a  "higher  degree  of  acceptance  among  employees"  who  are  in¬ 
cluded  in  the  merit  pay  system.  In  our  2-year  review  of  the 
merit  pay  system,  we  found  that  most  employees  at  three  depart¬ 
ments — Agriculture,  HUD,  and  Navy — did  not  believe  that  merit 
pay  had  been  successful,  or  that  it  had  increased  motivation  or 
performance.  For  example,  in  both  years  in  each  agency,  between 
78  and  86  percent  of  the  employees  believed  merit  pay  had  not 
motivated  them  to  better  performance,  and  about  80  percent  in 
both  years  in  each  agency  believed  they  were  no  more  productive 
under  merit  pay.  Also,  in  both  years,  7  percent  or  fewer  of 
surveyed  employees  favored  retaining  the  present  merit  pay 
system. 

2.  Are  these  conclusions  supportable  by  fact? 

OPM's  report  is  based  on  (1)  the  Federal  Employee  Attitude 
Surveys  for  1979  and  1980  which  took  place  before  merit  pay  was 
fully  implemented  in  October  1981 ;  (2)  performance  appraisal 
ratings  distributions  for  a  limited  number  of  merit  pay 
employees  for  fiscal  years  1981  and  1982;  (3)  Merit  Pay  first 
Year  Experiences  in  Eight  Federal  Agencies,  an  analysis  of  eight 
agencies  representing  about  2,200  merit  pay  employees  which 
implemented  merit  pay  a  year  early  in  October  1980;  and  (4) 

OPM's  own  merit  pay  experience  involving  400  employees  over  the 
past  3  years.  These  studies  and  analyses  are  either  not  current 
or  not  projectable  to. a  governmentwide  merit  pay  system,  which, 
according  to  OPM,  covers  about  108,000  employees. 

3.  What  results  have  your  reviews  produced  on  these 

questionS? 

In  1982,  ratings  and  payouts  were  made  in  a  timely  manner. 
However,  we  identified,  and  employees  perceived,  several  prob¬ 
lems  with  the  performance  appraisal  systems.  We  identified 
instances  where  ratings  were  altered,  apparently  to  meet  a  quota 
or  preestablished  distribution  of  ratings.  OPM  regulations  pro¬ 
hibit  forcing  rating  distributions  to  fit  quotas.  Between  37 
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and  43  percent  of  the  employees  in  each  agency  in  1981,  and  from 
39  to  52  percent  in  1982  believed  their  ratings  were  inaccur¬ 
ate.  Moreover,  between  28^ and  48  percent  of  the  employees  be¬ 
lieved  appraisals  had  become  more  subjective  since  the  inception 
of  merit  pay,  despite  the  fact  that  appraisals  were  to  be  more 
objective  under  merit  pay.  Over  40  percent  of  employees  in  each 
agency  in  1982  cited  inconsistencies  in  raters'  judgments  within 
the  pool  as  a  great  or  very  great  problem.  Finally,  in  1981, 
between  43  and  62  percent  of  the  employees  in  each  agency 
thought  the  performance  appraisal  system  should  not  be  retained 
even  if  it  were  not  tied  to  merit  pay.  In  1982,  between  47  and 
59  percent  in  each  agency  held  this  view. 

Our  review  of  agency  merit  payout  data  showed  that  within  a 
given  merit  pay  unit,  a  higher  rated  employee  generally  received 
a  larger  merit  pay  increase  than  a  similarly  graded  employee 
with  a  lower  performance  rating.  However,  such  factors  as  the 
composition  of  employees — grades  and  positions  in  the  salary 
ranges — in  a  merit  pay  pool,  and  the  distribution  of  ratings  in 
the  pool  all  can,  and  did,  cause  the  payouts  to  vary  widely 
between  pools.  As  a  result,  it  was  not  uncommon  for  a  lower 
rated  employee  in  one  pool  to  receive  a  larger  increase  than  a 
higher  rated  employee  in  another.  While  these  differences  are 
permitted  under  the  law  they  contribute  to  the  negative  employee 
perceptions. 

Neither  the  performance  appraisal  nor  the  merit  pay  system 
is  well  accepted  by  the  employees  in  the  three  agencies.  Em¬ 
ployees  were  particularly  concerned  over  the  systems'  fairness, 
objectivity,  and  accuracy. 

4.  Would  you  provide  an  analysis  of  the  PPM  report,  and  sublit 
your  finding  to  the  co—ittee? 

We  do  not  believe  that  the  OPM  data  fully  support  the  con¬ 
clusions  in  the  report.  Our  comments  on  specific  statements  in 
the  report  follow. 

On  page  13,  OPM  states  that 

"Data  regarding  employee  attitudes  about  performance 
appraisal  are  available  from  the  Federal  Employee 
Attitude  Survey.  ...  It  is  clear  from  this  data 
that,  as  the  new  performance  appraisal  system  was  be¬ 
ing  implemented,  employees  found  the  new  system  more 
fair.  .  .  .  With  three  subsequent  years  of  upgrading 
.  .  .it  is  just  not  credible  to  believe  that  employ¬ 
ees  can  think  the  system  is  any  less  fair  today.” 

The  most  recent  Federal  Employee  Attitude  Survey  was  con¬ 
ducted  in  November  1980,  with  a  followup  to  nonrespondents  in 
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March  1981,  about  7  months  before  merit  pay  was  fully  imple¬ 
mented.  Of  the  over  9,000  returned  surveys,  only  260  respon¬ 
dents  had  experienced  a  merit  payout. 

Merit  pay  employees  responding  to  GAO  questionnaires  after 
the  1981  and  1982  payouts  questioned  the  fairness  of  the  sys¬ 
tem.  Over  40  percent  in  each  agency  thought  the  merit  pay  and 
performance  appraisal  systems  in  1982  were  unfair  or  very  un¬ 
fair.  Between  28  and  48  percent  in  each  agency  felt  that  rat¬ 
ings  had  become  more  subjective  since  merit  pay/performance 
appraisal  was  instituted.  Further,  between  41  and  54  percent  of 
the  employees  in  each  agency  thought  merit  pay  was  not  fairer  in 
1982  than  in  1981.  Also,  a  study  contracted  by  OPM  with  Case 
Western  Reserve  University  and  published  in  1982  concluded  that, 
at  the  Environmental  Protection  Agency  (EPA)  there  was  a  "sub¬ 
stantial  decrease  in  support  for  performance  appraisal  and  merit 
pay  between  October  1980  and  October  1981."  EPA  was  one  of  the 
eight  agencies  that  made  merit  payouts  in  October  1980. 

On  page  13,  OPM  concluded  that 

"...  the  present  performance  appraisal  system's  in¬ 
tegrity  is  infinitely  better  than  that  of  the  pre- 
CSRA  evaluation  system." 

As  support  for  this  statement,  OPM  shows  in  a  table  that 
under  the  merit  pay  system  ratings  are  spread  out  over  more  per¬ 
formance  levels  than  under  the  old  system.  Many  agencies  now 
have  5-level  rating  systems  instead  of  the  3-level  system  used 
before  the  Civil  Service  Reform  Act,  so  it  is  a  natural  con¬ 
sequence  that  ratings  would  fall  into  more  categories.  Such  a 
rating  spread  does  not  necessarily  mean  that  the  integrity  of 
the  system  has  improved.  Further,  in  our  view,  the  integrity  of 
a  performance  appraisal  system  is  a  function  of  its  ability  to 
accurately  differentiate  employee  performance.  This,  in  turn, 
depends  upon  the  quality  and  validity  of  performance  elements 
and  standards.  Our  work  indicates  that  performance  standards 
need  to  be  improved  to  become  valid  measures  of  employee 
performance. 

On  page  15,  OPM  states  that 

"...  figures  from  the  1982  merit  pay  experience 
bear  out  the  fact  that  the  performance  appraisal 
system  is  continuing  to  improve." 

As  evidence  for  this  conclusion,  OPM  cites  the  same  table 
referred  to  above,  which  shows  that  the  percentage  of  high  rat¬ 
ings  decreased  slightly  from  1981  to  1982,  while  the  percentage 
of  fully  successful  ratings  increased. 
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According  to  OPM  officials  responsible  for  this  report,  the 
data  shown  for  fiscal  year  1981  came  from  a  telephone  survey  of 
agencies.  They  could  not  tell  us  how  many  agencies  were  sur¬ 
veyed  or  what  percent  of  the  merit  pay  population  they  repre¬ 
sented.  The  data  shown  for  fiscal  year  1982  came  from  an  OPM 
study1  which  contained  rating  data  from  about  16  percent  of  the 
merit  pay  population.  In  contrast,  our  analysis  of  rating  data 
shows  that  more  employees  were  rated  higher  than  fully  sat¬ 
isfactory  in  1982  than  in  1981  at  both  Agriculture  and  Navy, 
which  together  employ  about  24  percent  of  the  merit  pay  popula¬ 
tion.  At  HUD,  fewer  employees  were  rated  outstanding  in  1982. 

In  its  report,  OPM  equates  a  particular  rating  distribution 
with  a  good  performance  appraisal  system.  This  overlooks  other 
factors  that  go  into  determining  whether  a  performance  appraisal 
system  is  "good,"  such  as  the  quality  of  elements  and  standards, 
the  degree  of  employee  involvement  in  setting  the  standards,  and 
the  perceived  accuracy  and  fairness  of  the  ratings. 

On  page  1 5 ,  OPM  says 

"All  the  evidence,  therefore,  supports  the  conclusion 
that  the  performance  appraisal  system  has  improved  so 
that  it  now  is  supported  by  employees,  does  distin¬ 
guish  between  levels  of  performance,  and  has  over 
time  increasingly  refined  levels  of  performance." 

As  mentioned  earlier,  our  questionnaire  data,  testimony 
from  representatives  of  merit  pay  employee  groups,  and  OPM's  own 
contract  studies  raise  doubts  as  to  whether  performance  ap¬ 
praisal  systems  are  supported  by  employees.  There  is  no  ques¬ 
tion  that  employee  ratings  in  most  agencies  are  now  spread  over 
more  performance  levels  than  before  merit  pay.  However,  refin¬ 
ing  performance  levels,  as  mentioned  earlier,  is  the  function  of 
performance  elements  and  standards.  Our  studies  have  shown  that 
these  standards  are  often  incapable  of  distinguishing  between 
performance  levels,  and  that  improvements  to  the  standards  are 
needed . 

On  page  17,  OPM  states 

"It  easily  can  be  seen  from  the  table,  however,  that 
these  [employee]  perceptions  of  unfairness  were  re¬ 
lated  to  the  weakness  of  the  performance  appraisal 
systems  in  these  two  agencies  [EPA  and  SB A]  at  that 
time. " 


^his  study.  Fiscal  Year  1982  Merit  Pay  Program  Report  was  based 
on  combined  payout  and  performance  appraisal  data  on  19,000  of 
a  total  1981  population  of  about  117,000  merit  pay  employees. 
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OPM  is  equating  the  distribution  of  ratings  with  the 
strength  of  the  system — the  closer  the  system  is  to  OPM's  "opti¬ 
mum"  rating  distribution,  the  stronger  the  system  is. 

As  shown  in  table  3  (p.  4)  of  the  study,  however,  a  higher 
percentage  of  employees  in  the  Farm  Credit  Administration  (FCA), 
whose  rating  distribution  most  closely  matched  OPM's  optimum, 
thought  the  merit  payouts  were  unfair  as  compared  to  the  Civil 
Aeronautics  Board  (CAB),  whose  system  OPM  categorized  as  "too 
lax."  In  fact,  in  its  1980  report  on  the  test  study  of  the 
eight  agencies  that  implemented  merit  pay  a  year  early,  OPM 
concluded  that  "employees  at  CAB  and  FCA  appear  to  be  the 
most  satisfied  with  merit  pay  as  it  functioned  in  their 
organizations. " 

On  page  18,  OPM  says 

"Informal  agency  and  employee  comments,  however,  sug¬ 
gest  the  1982  payout  was  successful." 

This  was  not  a  scientific  sample  nor  is  this  information 
projectable  to  the  merit  pay  population.  In  contrast,  our  ques¬ 
tionnaire  results,  projectable  to  the  three  agencies,  showed  em¬ 
ployee  dissatisfaction  with  merit  pay  in  1982  to  be  about  as 
great  as  it  was  in  1981.  For  example,'  between  41  and  54  percent 
of  employees  in  each  agency  believed  merit  pay  was  not  fairer  in 
1982  than  in  1981,  and  in  both  years,  about  the  same  percentage 
of  employees  in  each  agency  (between  4  and  7  percent)  wanted  to 
retain  the  merit  pay  system  as  implemented. 

On  page  22,  OPM  states 

"Clearly,  outstanding  performance  is  very  well  re¬ 
warded  under  the  merit  pay-for-performance  system 
.  .  .  nearly  one  fourth  received  substantially  more 
than  they  would  have  been  compensated  without  pay- 
for-performance  . " 

As  support  for  this  statement  about  merit  pay  employees  in 
general,  OPM  cites  the  increases  received  by  a  sample  of  OPM  em¬ 
ployees  since  merit  pay  began.  OPM  concluded  that,  in  3  years, 
top  performers  have  gone  up  the  equivalent  of  almost  three 
within-grade  steps,  and  that  24  percent  of  its  employees  re¬ 
ceived  substantially  more  and  31  percent  received  less  than  if 
they  had  remained  under  the  General  Schedule  over  that  period. 

Table  6  in  OPM's  report  shows  that  top  performers  went  up 
two  and  one-half  steps  in  3  years.  However,  how  an  employee 
fares  in  the  General  Schedule  depends,  for  the  most  part,  on 
the  employee's  position  or  step  in  the  salary  range.  For 
example,  a  General  Schedule  employee  in  the  first  step  who  is 
rated  average  would  receive  three  step  increases  in  3  years 
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which  is  more  than  the  top  OPM  performers,  and  an  employee  in 
the  middle  three  steps  would  receive  one  and  possibly  two  step 
increases  over  the  same  period.  Table  6  of  the  OPM  report  also 
shows  that  employees  with  "average"  performance  ratings  who 
comprised  68  percent  of  the  merit  pay  employees,  received  less 
than  a  full  step  increase  over  the  3-year  period.  Thus,  em¬ 
ployees  in  the  first  six  steps  of  their  grade  who  were  rated  at 
least  "average"  may  have  been  better  off  in  the  General 
Schedule. 

Our  questionnaire  data  showed  that  between  41  and  52  per¬ 
cent  of  the  employees  in  each  department  in  1982  believed  that 
they  had  earned  less  under  merit  pay  than  they  would  have  under 
the  General  Schedule. 

On  page  22,  OPM  notes 

"This  conclusion  for  OPM  can  be  generalized  govern¬ 
ment  wide  by  the  agency  data  which  are  available  in 
OPM's  government-wide  management  information  system." 

The  data  presented,  however,  are  only  representative  of 
OPM — the  OPM  merit  pay  population  is  about  one  half  of  1  percent 
of  the  Federal  merit  pay  population.  Also,  OPM  does  not  cite 
any  statistics  from  its  management  information  system  to  demon¬ 
strate  that  the  OPM  experience  can  be  generalized  on  a  govern¬ 
mentwide  basis. 

On  page  24,  OPM  states 

"The  experience  thus  far  with  the  merit  pay  system, 
as  shown  in  test  year  experience  .  .  .  demonstrates 
clearly  the  program's  success." 

Our  work  has  shown  that,  for  about  25  percent  of  the  fed¬ 
eral  merit  pay  population,  most  employees  are  dissatisfied  with 
many  aspects  of  the  merit  pay  system.  The  system  has,  according 
to  a  majority  of  employees  and  pool  officials,  failed  to  moti¬ 
vate  employees  or  improve  their  productivity  and  has  created 
morale  problems.  About  80  percent  of  our  survey  respondents  in 
each  agency  in  both  years  thought  that  the  benefits  of  the  new 
systems  did  not  justify  the  time  and  effort  required  to  operate 
them.  In  addition,  an  OPM-financed  study  by  the  University  of 
Michigan  concluded  that  "it  [merit  pay]  is  not  now  serving  its 
purposes  of  promoting  pay  equity  and  stimulating  improved  effort 
and  performance." 
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On  page  24,  PPM  concludes 


"...  this  information  argues  strongly  for  expanding 
pay-for-per formance  to  cover  the  entire  general 
schedule  work  force,  and  demonstrates  clearly  that 
the  performance  appraisal  system  is  quite  capable  of 
bearing  the  additional  'weight'  imposed  by  such  a 
system. " 

We  do  not  believe  that  data  presented  by  0PM  in  this  report 
support  this  conclusion.  Attitudinal  data  presented  by  OPM  are 
more  than  2  years  old  and  were  collected  before  merit  pay  was 
fully  implemented. 

Further,  OPM  offers  no  evidence  that  the  appraisal  systems 
for  the  remainder  of  the  General  Schedule  population  are  fair, 
accurate,  or  improving.  Our  review  of  General  Schedule  perform¬ 
ance  appraisal  systems  showed  that  refinements  are  needed  to 
such  systems  and  an  OPM-financed  study  by  the  University  of 
California  concluded  that  "there  is  no  indication  that  the  merit 
pay  experiment  at  grades  13-15  has  been  sufficiently  successful 
to  proceed  with  plans  to  include  employees  in  grades  1-12." 
Further,  another  study  published  by  OPM-financed  researchers  in 
January  1983  concluded  that 

"...  merit  pay  is  not  working  in  our  two  agencies 
or  in  most  of  the  other  agencies  in  which  evaluations 
are  taking  place.  By  not  working  we  mean  that  it  is 
not  widely  accepted,  it  is  not  seen  as  an  improve¬ 
ment,  it  is  not  rewarding  deserving  people  fairly 
with  significant  raises,  and  it  is  not  contributing 
to  agency  effectiveness." 

Based  on  the  difficulties  we  identified  with  OPM's  report, 
we  do  not  believe  it  provides  support  for  the  conclusions  it 
reached  regarding  the  extension  of  merit  pay  to  other  employees 
and  agencies  at  this  time.  However,  it  should  be  noted  that  it 
takes  several  years  of  operation  before  the  positive  an'  ne  a- 
tive  aspects  of  a  merit  pay  system  can  be  adequately  determined. 
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Washington,  D  C.  20415 

In  top*  (W  To  Yon  totem* 


Honorable  Jeff  Blngaaan 
Ranking  Minority  Member 
Subcommittee  on  Civil  Service, 

Poet  Office  and  General  Services 
Committee  on  Governmental  Affairs 
United  States  Senate 
Washington,  D.C.  20510 


Dear  Senator  Blngaman: 

During  your  last  hearing  on  the  subject,  you  Inquired  whether  0PM  would 
conduct  a  study  on  the  subject  of  the  Relationship  between  pay  and  per¬ 
formance  In  the  Federal  sector.  I  have  authorised  such  an  examination. 

I  am  happy  to  send  you  the  results  of  that  Investigation,  "Report  on  Pay 
for  Performance  In  the  Federal  Government."  The  study,  covering  the 
years  1980-1982,  la  a  review  of  the  "pay  for  performance"  concept  under 
the  Civil  Service  Rafoxm  Act  of  1978.  The  data  collaeted  by  OKI  demon¬ 
strates  the  soundness  of  the  pay  for  performance  concept  and  Improvements 
In  the  system  during  the  past  two  years. 

If  I  can  be  of  any  further  assistance  to  you,  please  do  not  hesitate  to 
contact  me. 


V 


United  States 

Office  of 
Personnel  Management 

JUL  12  KB 


Enclosure 
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REPORT  ON 

PAT  FOR  PERFORMANCE 
THE  FEOERAL  GOVERNMENT 
1980  -  1982 


li‘S*  °folSe  of  Personne!  Mana.;enent 
June,  1983  * 
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I.  PERFORMANCE  APPRAISALS 

Pay-for-performance  was  established  by  the  Civil  Service  Reform  Act 
(CSRA)  of  1978  for  mid-level  managers,  GS-13  to  GS-15.  Pay-outs  were  to  be 
based  upon  ratings  under  a  new  "performance  appraisal"  system  for  rating 
employees'  performance.  It  was  clear  from  the  outset,  that 
pay-for-performance  was  dependent  upon  fair  and  accurate  performance 
appraisals. 

Data  regarding  employee  attitudes  about  performance  appraisal  are 
available  from  the  Federal  Employee  Attitude  Survey,  a  scientific  sample  of 
Federal  workers  attitudes.  It  is  clear  from  this  data  that,  as  the  new 
performance  appraisal  system  was  being  implemented,  employees  found  the  new 
system  more  fair.  In  1979,  slightly  less  than  a  majority  found  appraisals 
TABLE  1:  Employee  Attitudes  on  Performance  Appraisal 

1979  1980 

Percent  who  think  appraisals  are  fair  49%  655 

fair,  but  6  in  10  did  in  1980.  With  three  subsequent  years  of  upgrading  of 
the  system,  it  Is  just  not  credible  to  believe  that  employees  can  think  the 
system  Is  any  less  fair  today. 

Table  2  shows  that  the  present  performance  appraisal  system's  integrity 
Is  Infinitely  better  than  that  of  the  pre-CSRA  evaluation  system.  Whereas 
over  98  percent  were  rated  at  one  rating  before  CSRA,  the  first  year  after 
implementation  of  the  new  appraisal  system,  ratings  spread  across  at  least 
three  major  categories.  Although  the  new  system  is  far  from  an  ideal 
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distribution,  it  does  make  distinctions  between  levels  of  perronnance. 

Figures  from  the  1982  merit  pay  experience  bear  out  the  fact  that  the 
performance  appraisal  system  is  continuing  to  improve.  As  Table  2  shows,  the 
percentage  of  people  rated  fully  successful  increased  over  the  1981  results, 
while  the  percentage  of  those  rated  above  fully  successful  decreased.  While 
the  percentage  of  those  rated  above  the  fully  successful  level  continues  to 
be  higher  than  the  roughly  30  percent  which  would  appear  in  an  optimum 
distribution,  the  progress  to  date  is  indicative  of  real  improvement.  The 
1982  data  show  a  mean  performance  result  of  3.8  on  a  five  point  scale.  Thus, 
the  mean  rating  is  now  lower  than  the  "exceeds  fully  successful"  rating. 

There  is  every  reason  to  believe  that  the  improvements  in  the 
performance  appraisal  distributions  of  1982  over  1981  will  be  repeated  in 
1983.  Supervisors  and  employees  alike  are  becoming  even  more  accustomed  to- 
the  procedures  used  In  the  system.  Agincies  and  individuals  also  have 
received  additional  training,  and  now  have  a  better  understanding  of  the 
rating  system  and  Its  Importance.  All  :he  evidence,  therefore,  supports  the 
conclusion  that  the  performance  appraisal  system  has  improved  so  that  it  now 
Is  supported  by  employees,  does  distinguish  between  levels  of  performance, 
and  has  over  time  Increasingly  refined  levels  of  performance. 

II.  THE  PILOT  MERIT  PAY  STUDY  IN  1980 

Merit  pay  for  managers  was  set  for  full  Implementation  in  1981.  To 
prepare  for  this  Implementation,  a  test  study  was  done  a  year  earlier  in 
eight  Federal  agencies,  to  anticipate  problems  and  to  have  a  data  base  upon 
which  to  proceed  for  the  full  Implementation  of  pay-for-performance  the  next 
year.  Table  3  below  summarizes  the  results  of  that  study  (for  the  six 
agencies  for  which  complete  data  are  available). 
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The  first  important  conclusion  from  the  table  is  that  employees 
generally  believe  that  the  pay-outs  under  merit  pay  were  fair,  and  only  a 
very  few  thought  they  were  unfair.  There  were  two  exceptions  to  this  general 
finding:  42  percent  of  employees  in  EPA  thought  their  distribution  was  unfair 
and  45  percent  in  S8A.  It  easily  can  be  seen  from  the  table,  however,  that 
these  perceptions  of  unfairness  were  related  to  the  weakness  of  the 
performance  appraisal  systems  in  these  two  agencies  at  that  time.  A  good 
distribution  of  appraisals  above  the  "fully  successful"  level  is  usually 
recognized  to  be  about  30  percent.  It  should  be  noted  that  the  two  agencies 
that  have  this  kind  of  performance  appraisal  distribution  have  a  good 
distributions  of  performance  pay-outs,  and  very  high  perceptions  of  fairness 
among  employees. 

It  is  extremely  interesting  to  note  that  the  two  cases  of  high 
perceived  unfairness  represent  two  different  and  extreme  problems  with 
performance  appraisals.  In  one  case,  the  ratings  were  too  lax— with  85 
percent  of  employees  rated  above  ffilly  successful.  Tne  pay-out  rates  for 
outstanding  performers  under  this  la>  situation  were  rather  low,  and  even 
more  interestingly,  the  pay-out  rates  for  fully  successful  employees  was 
quite  low  too.  Good  employees  at  all  rating  levels  suffered  from  this 
"over -gaming"  of  Inflated  performance  ratings.  Moreover,  these  results  were 
very  unpopular  among  employees.  In  the  other  case,  appraisals  were  too 
severe  in  the  opposite  direction.  On  order  to  guarantee  outstanding 
performers  a  very  high  pay-out  (of  20  percent),  only  17  percent  of  ratings 
were  given  above  fully  successful.  This,  too,  resulted  in  a  perception  of 
unfairness  among  employees. 


OPM  is  not  aware  of  any  current  examples  of  the  "too  severe" 
distribution  among  agencies.  There  are  agencies,  however,  that  have  a  rating 
inflation  problem.  Most  of  these  cases  are  closer  to  the  CAB  (80  percent 
above  fully  successful)  level,  which  is  less  damaging  for  a  performance 
pay-out  system.  All  agencies  have  been  informed  of  both  of  these  problems 
and  their  adverse  effects,  and  managers  have  been  trained  how  to  avoid  them 
by  good  performance  management.  The  result  Is  that  agencies  are  moving  into 
the  "moderately  good"  category  and  we,  therefore,  can  anticipate  the 
relatively  good  results  shown  for  OPM  in  Table  3. 

III.  THE  OPM  EXPERIENCE  1980  -  1982 

It  was  decided  not  to  analyze  gove eminent -wide  data  on  the  merit  pay 
system  for  1981.  The  acting  Controller  General,  just  a  few  days  before  merit 
pay  was  to  be  implemented,  ruled  that  approximately  40  percent  of  the 
discretionary  pay  pool  could  not  be  paid  out  under  the  merit  pay  system. 

OPM  modified  the  system  to  make  the  best  out  of  a  bad  situation,  but 
recognized  that  the  system  could  never  work  with  full  effectiveness  with  40 
percent  of  its  bonus  pool  taken  away.  This  experience  In  1982  obviously  gave 
a  poor  start  for  merit  pay,  and  even  had  adverse  effects  for  the  agencies 
which  had  successfully  tested  It  a  year  earlier.  Yet,  this  obviously  was  not 
the  fault  of  the  system,  but  resulted  from  the  fact  that  It  was  underfunded 
after  the  late  GAO  decision.  So  It  did  not  make  sense  to  do  a  full  scale 
evaluation  under  those  circumstances. 

Informal  agency  and  employee  comments,  however,  suggest  the  1982 
pay-out  was  successful.  These  comments  were  especially  common  before  the  new 
reforms  were  announced.  Yet,  OPM  has  systematically  studied  Its  own  merit 
pay  system  over  the  past  three  years.  These  data  provide  a  good  indication  of 
the  strengths  of  a  pay-for-performance  system.^ 
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The  overall  performance  distribution  has  marginally  improved  over 
the  three  years.  At  the  end  of  the  third  year,  it  would  still  only  fall  in 
the  “moderately  g>od"  range,  with  61  percent  of  merit  pay  ratings  above  fully 
successful.  However,  Table  4  shows  that  there  were  important  changes  within 
the  overall  ratings.  The  average  rating  went  down  from  2.0  to  1.9,  and  the 
top  outstanding  rate  ranges  decreased  from  15  percent  of  employees  to  a  much 
more  reasonable  8  percent.  This  trend  toward  more  realistic  ratings  is 
further  illustrated  by  data  which  show  that  from  1981  to  1982,  51  percent  of 
the  ratings  were  reduced,  while  only  29  percent  increased. 

Senior  executive  ratings  have  changed  even  more  dramatically,  as  shown 
in  Table  5.  In '1980,  23  percent  were  rated  outstanding,  compared  to  only  14 
percent  today.  Those  rated  above  fully  successful  dropped  from  an  inflated  86 
percent  the  first  year  to  a  more  realistic  '52  percent  the  third  year.  Fully 
successful  ratings,  meant  to  be  the  average  rating,  increased  from  14  percent 


to  a  modal  41  percent. 

TABLE  5.  0PM  Senior  Executive  Performance  Ratings 

• 

1980 

1981 

1982 

Outstanding 

~m 

20t 

~m 

Exceeds  Fully  Successful 

63 

57 

38 

Fully  Successful 

14 

22 

41 

Minimally  Successful 

0 

0 

7 

Unsatisfactory 

Q 

0 

0 

Table  6  tracks  the  merit  pay-out  over  a  four  year  period— from  the  old 
within-grade  system  through  the  three  years  of  merit  pay.  Starting  from  an 
average  of  step  4  on  the  old  range,  the  table  shows  that  different  levels  of 
performance  clearly  have  resulted  in  different  pay-out  patterns.  The  largest 
group,  the  average  performance  employees,  has  increased  about  one  step, 
approximately  what  they  would  have  earned  under  the  old  within-grade  system. 
More  importantly,  the  top  performers  have  gone  up  almost  three  steps! 
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Clearly,  outstanding  performance  is  very  well  rewarded  under  the  merit 
pay-for-perforrance  system. 

Table  7  looks  at  the  net  effect  on  employees  over  the  three  year 
period.  Nearly  half  of  employees  (45  percent)  received  approximately  what 
they  would  have  received  under  the  old  within-grade  system.  About  31 
percent  received  less.  But  nearly  one-fourth  (24  percent)  received 
substantially  more  than  they  would  have  been  compensated  without 
pay-for-performance.  Hence,  7  out  of  10  employees  are  being  compensated  as 
well  or  better  after  three  years  of  merit  pay  than  under  the  old 
within-grade  system. 

This  conclusion  for  0PM  can  be  generalized  government-wide  by  the 
agency  data  which  are  available  in  OPM's  government-wide  management 
information  system.  These  data  show  that  across  government  there  is  a 
statistically  significant  relationship  between  the  dollar  amounts  of 
individual  merit  payouts  and  the  summary  results  of  performance  appraisals 
for  individual  employees.  These,  together  with  the  0PM  results,  provide 
face  validity  for  the  ability  of  the  appraisal  process  to  support  a 
meaningful  pay  for  performance  system. 

IV.  CONCLUSION 

All  of  the  data  available  to  date  support  two  important  conclusions: 
the  Federal  government's  new  performance  appraisal  system  is  functioning 
very  well,  less  than  two  years  after  its  establishment.  And 
pay-for-performance,  presently  effective  only  for  higher-graded  managers 
aw'  supervisors,  has  been  effective  in  providing  greater  rewards  for  above 
average  performers,  while  achieving  a  high  degree  of  acceptance  among 
employees. 

The  performance  appraisal  system  established  by  the  Civil  Service 
Reform  Act,  and  implemented  fully  on  October  1,  1981,  is  a  major 
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EFFECT  OF  THREE  YEARS  OF  MERIT  PAY  ON  SALARIES 
1900-1982  400  EMPLOYEES 


«•  INCREASE  LESS  THAN  STEP  EXPECTED 
»»  INCREASE  LESS  THAN  I  STEP  HIGHER 
»»»  INCREASE  1  STEP  OR  HORE  HIGHER 
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improvement  over  the  system  previously  used,  and  has  benefited  from  a  ' 

determined  effort  to  upgrade  elements  and  standards  by  agencies  since  that 
time.  While  the  gains  are  small  In  some  instances,  others  are  greater,  and 
j11  of  the  change  is  In  the  direction  of  significant  improvement. 

In  fact,  improving  and  upgrading  the  performance  appraisal  system  has 
been  the  top  priority  of  the  Office  of  Personnel  Management  over  the  past  two 
years:  It  has  been  the  subject  of  Cabinet  deliberations  on  two  separate 
occasions,  it  Is  discussed  on  a  regular  continuing  basis  with  assistant 
secretaries  for  personnel  and  agency  personnel  officers,  and  a  large  number  of 
training  sessions  have  been  held  to  upgrade  the  performance  management  skills 
of  agency  managers. 

The  experience  thus  far  with  the  merit  pay  system,  as  shown  in  test  year 
experience,  as  well  as  OPM's  regular  evaluations,  demonstrates  clearly  the 
program's  success.  Where  the  performance  appraisal  system  on  which  merit  pay 
is  based  is  sound,  or  even  marginally  sound,  the  system  gives  the  desired 
payouts,  and  is  perceived  as  fair  by  employees.  Outstanding  performers  easily 
can  receive  the  equivalent  of  step  increases  three  steps  above  where  they  would 
be  under  the  old  general  schedule  within-grade  system.  Most  employees  do  as 
well  as  they  would  have  under  the  old  system,  while  more  than  one-quarter  of 
employees  are  better  off  under  pay-for-performance  because  of  the  financial 
rewards  given  them  for  their  better-than-average  performance. 

Taken  together,  this  Information  argues  strongly  for  expanding 
pay-for-performance  to  cover  the  entire  general  schedule  work  force,  and 
demonstrates  clearly  that  the  performance  appraisal  system  is  quite  capable  of 
tearing  the  additional  •weight*  imposed  by  such  a  system.  The  Federal 
government  is  ready  to  join  the  private  sector  in  basing  pay  on  how 

well  employees  perform. 

(966130) 
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